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Abstract 


In this paper, we consider the linear quadratic optimal control 
problem on infinite time interval for linear time-invariant systems defined on 
Hilbert spaces. The optimal control is given by a feedback form in terms of 
solution n to the associated algebraic Riccati equation (ARE). A Ritz type 
approximation is used to obtain a sequence n N of finite dimensional 
approximations of the solution to ARE. A sufficient condition that shows n N 
converges strongly to n is obtained. Under this condition, we derive a 

formula which can be used to obtain a rate of convergence of n N to n. 
We demonstrate and apply the results for the Galerkin approximation for 
parabolic systems and the averaging approximation for hereditary differential 
systems. 
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1. Introduction 

Assume Z, U and Y arc Hilbert spaces. Consider the evolution 

equation on Z 

(1.1) z(t) = A z(t) + B u(t) , z(0) = z 0 € Z 

where u(t) is a U-valued control function, A is the infinitesimal generator of 
strongly continuous semigroup S(t) on Z, and B € £(U,Z). The Y-valued 
observation function y is given by 

(1.2) y(t) = C z(t) , t > 0 . 

We assume that C € £( Z,Y). We interpret the equation (1.1) in the mild sense; 
the solution of (1.1) is given by 

(1.3) z(t) = S(t)z 0 + [ S(t-s)tf u(s)ds . 

•o 

Consider the minimization problem; minimize the cost functional 

(1.4) J(u,z 0 ) = p (||y(t)|| 2 + ||u(t)|| 2 )dt 

Jq 

subject to (1.3). Then the following result is well-known [10],[11]: 

Theorem 1.1 Assume (A>B) is stabilizable and ( A t C ) is detectable. Then 

there exists a unique nonnegative self-adjoint solution n to the algebraic 
Riccati equation in Z: 

(1.5) (A*U + IL4 - UBB*n + C*C ) z = 0 for all z € dom(^) f 
and the optimal solution u° to (1.4) is given by 

u°(t) = -B*n T(t)z 0 

where T(t) is the strongly continuous semigroup generated by A - BB * n 
and it is uniformly exponentially stable. 
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Here we have 

Definition 1.2 (1) ( A,B ) is stabilizable if there exists an operator 

K € £(Z,U) such that A-BK generates a uniformly exponentially stable 
semigroup on Z. 

(2) (/t,C) is detectable if there exists an operator G € E(Y,Z) such that A - GC 
generates a uniformly exponentially stable semigroup. 

The purpose here is to construct a finite dimensional approximation 
of the optimal feedback gain operator B*n. Let us consider a sequence of 
approximating problems (Z N ,^ N ,fi N ,C N ); let Z N be a sequence of finite 
dimensional subspaces of Z and P N be the orthogonal projection of Z onto 
Z N . Assume A N : Z N -*Z N , Z? N : U -* Z N and C N : Z N -* Y are continuous. 
Then consider the Nth approximating problem of (1.4) 

(1.6) minimize J N (u,z 0 ) = | q (||C N z N (t)|| 2 + ||u(t)|| 2 )dt 
subject to 

(1.7) z N (t) = S N (t)P N z 0 + [ S N (t-s)S N u(s)ds 

where S N (t) = e^ Nt , t > 0. Then the optimal control u N of (1.6) is given 
by 

u N (t) = - B NVe(^- fiNfiN ’ n N )t P N Z() , t * 0 

where n N : Z N -* Z N is self-adjoint and satisfies the Nth approximating 
algebraic Riccati equation in Z N ; 

(1.8) ^ N *n N + n N y4 N - n N R N £ N *n N + c N *c N = 0 . 

Here, £ N *n N , N £ 1 yields a sequence of finite dimensional approximations of 
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the optimal feedback gain [3]. 

In this paper we first obtain a condition on (Z N ^ N ,i? N ,C N ) for which 
(1.8) admits a unique nonnegative solution n N , and n N P N converges strongly to n 
in §2. Such a condition has been discussed in [2], [3] but the condition in this 
paper improves those in [2], [3], i.e., we introduce the uniform detectability 
condition (see, (H3) in §2, for the definition) which is additional to those 
considered in [2], and using this condition, we are able to show that there 
exists an integer N 0 such that for N * N 0 

|| e (,4 N -£ N B N n N )t p N|| « m e' ut , t > 0 

for positive constants M > 1 and w (independent of N ) N 0 ). This assertion 
is a part of assumptions in [2, Theorem 2.2]. The uniform detectability 
condition is satisfied if C*C is coercive, which is assumed in the discussions in 
[2,p. 693]. Thus, the uniform detectability condition can be regarded as a 
relaxation of the coercivity assumption mentioned above. Next, under the 
condition in §2 we derive a formula which provides a rate of convergence of 
n N to n and apply the formula for specific examples. 
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(Hl) For each z € Z, we have 

(i) S N (t)P N z - S(t)z , and 

(ii) .S N (t)*P N z - S*(t)z , 

where the convergences are uniform in t on bounded subsets of [O, 00 ). 

(H2) (i) For each u e U, S N u -* 5u and for each z e Z 

B n * P n z - B* z. 

(ii) For each z e Z, C N P N z -» Cz and for each y € Y 
C N *y -* C*y. 

(H3) (i) The family of the pairs (^ N ,iS N ) is uniformly stabilizable: i.e. 

there exists a sequence of operators € f(Z N ,U) such that 

sup||A: N || < « and 

,[e(/l N -fi N tf N )tpN|| ? Mje^t , t > 0 
for some positive constants Mj > 1 and . 

(ii) The family of the pairs (/1 N ,C N ) is uniformly detectable; i.e. 
there exists a sequence of operators C N € £(Y,Z N ) such that 
sup||C N j| < ® and 

II M ’ G C ' t P N || S M 2 e 2 , t > 0 
for some positive constants M 2 > 1 and w 2 . 

Remark (1) Suppose S N = P N fl and C N = CP N . Then (H2) holds 

since it follows from (HI) that P N z -» z for all z e Z. 

(2) The assumption (H3) is closely related to the preservation of 

exponential stability under approximation in [3,Conjecture 7.1] and it is shown 
in [2] that (H3) (i) ((POES) in [2]) is satisfied for parabolic systems using the 
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Galerkin approximation. 

(3) A natural way to argue (H3) is to take AT N = ATP N and C N = P N G for 

some K € £(Z,U) and G e £(Y,Z) such that A - BK and A - GC generate 
uniformly exponentially stable semigroups on Z. 

Theorem 2.1 Suppose (H1)-(H3) are satisfied. Then for each N, (1.8) 

admits a unique nonnegative solution n N , sup||n N || < ®, and there exist 
positive constants M 3 > 1 and w 3 (independent of n) such that 

i 4 n dN ftN* n N\ t N -U,t 

JJe^ ' B B n ' )t P N || < M 3 e 3 , t * 0 . 


Proof: The proof is based on the arguments in [11]. The existence and 

uniqueness of solutions to (1.8) follow from Theorem 1.1. Since 
<n N P N z,z > = min J N (u,z), (H3) (i) implies that 


<n N P N z,z> « J N (-/t: N z N ( - );z) 

- [" (||C N eW N -» N * N > 1 P' < z|| ! + || K N e (/( N -B N *: N )tpN 2 ||!) dt 
•"o 

$ 3 ||z || 2 for some positive constant 3 


Since n N is self-adjoint, nonnegative definite, this implies that ||n N || $ 3. 
By the variation of constants formula 


(2.1) e (/l N -5 N B N V)t = T N (t) + f‘ T N (t . s)(c; N c N. fi N fi N* n N )e (^ N -B N B N *n N )s ds 

n 


where T N (t) = e^ ^ t > 0. Here, from (1.8) 

(^ N -B N B N *n N )*n N + n N C4 N -£ N fl N *n N ) + n N B N B N *n N + C N *C N = 0 , 
so that if z N (t) = e ^ N ‘ 5NsN ^P 1 ^, t * 0, then 
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1. <z N (t),n N z N (t)> + ||S N *n N z N (t)|| J + ||C N z N (t)|| 2 = 0 

Thus, for all t > 0 

(2.2) <n N z N (t),z N (t)> + [ ( ||tf N *n N z N (t)| 2 + ||C N z N (t)|| 2 )dt 

s <n N P N z,z> $ 8||z|| 2 

Now, from (2.1), we have for all t > 0 

+ ||C N z N (s)|| 2 )ds 

where we have used the Young’s inequality. From (2.2), we have 
f ” M 2 

|| Z N (t) || 2 dt * _L(u 2 + 28 sup( ||G n || 2 + ||8 N || 2 ))||z|| 2 
J o w 2 

for all z e Z. Therefore, the theorem follows from the Datko’s theorem [7]. 

(Q.E.D.) 

The following is a consequence of [3, Theorem 6.9] and [2, Theorem 

2 . 2 ], 

Corollary 2.2 Suppose {A,B) is stabilizable and ( A,C ) is detectable and 

assume (HI) - (H3) are satisfied. Then the unique nonnegative solution n N 

to (1.8) converges strongly to n, the unique solution to (1.5). 

Theorem 2.3 Suppose that B is compact and £ N = P N i? and that 

(Hl)(i) and (H3)(i) are satisfied. Then (A,B) is stabilizable. 

Proof : Let us consider the case C = I and C N = P N with Y = Z. Then it is 

easy to show that ( A,C ) is detectable and (^ N ,C N ), n > 1 are uniformly 
detectable since (Hl)(i) implies that for some M £ 1 and w independent of N, 


M 2 

l|z N (s)|| 2 ds < — ? 


||5 n || 2 ) | (p N Vz N (s)|f 
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||S N (t)P N || $ Me 0 *, t * 0. It then follows from Theorem 1.1 and (H3)(i) that for 
each N, (1.8) with C N = P N has a unique solution n N . Using the same 

argument as in the proof of Theorem 2.1, we have ||n N || * 0 for some positive 
constant 0. Thus, by Theorem 6.5 in [3], there exists a subsequence of n N 
converges weakly to some nonnegative, self-adjoint operator n. We will show 
that n satisfies (1.5) with C = I. Since P N n N = n N , 0 N *n N = 

fi*P N n N = B*tF. Since B* is compact, for each z € Z, 5 Nj n Nj P N z converges 
strongly to B*nz. It now follows from [3, Theorem 6.7] that n satisfies (1.5) 

But since ( A,C ) is detectable, by [10, Theorem 3.2], A - BB * n generates a 
uniformly exponentially stable semigroup on Z. 

(Q.E.D.) 

Remark 2.4 Roughly speaking, Theorem 2.3 means that the uniform 

stabilizability implies the stabilizability of ( A,B ). The dual statement of 

Theorem 2.3 also holds: i.e., suppose C is compact, C N = CP N , then (Hl)(ii) 

and (H3)(ii) imply that ( A,C ) is detectable. This statement can be proved by 
applying the exactly same arguments as in the proof of Theorem 2.3 to the 
dual Riccati equation 

(AZ + Z A* - ZC*CZ + I) z = 0 


for all z e dom(/l*). 
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3. Convergence Rate 

In this section, we assume that (HI) and (H3) are satisfied and let 
Z? N = P N # and C N = CP N . Moreover, we assume 
(H4) For each z € Z, nz € dom(/4*) and B is compact. 

From (1.5), we have for all z 6 dom(.4) 

2<nz,,4z> - <5*nz,5*nz> + <Cz,Cz> = 0 
Thus, (H4) and the density of dom(<4) in Z imply that for all z € Z 

2<A*Tlz,z> - <B*nz,B*nz > + <Cz,Cz> = 0 . 

Define the self-adjoint operator n N = P N nP N . Then for all x e Z N 

(3.1) 2</4 N *n N x,x> - <B*ri N x, fi*n N x> + <C N x,C N x> + <A n x,x> = 0 , 
where A N « f(Z N ) is a self-adjoint operator defined by 

(3.2) <A n x,x> = 2<(A* - >4 N *P N )nx,x> 

+ <s*(n N - n N )x,fi*(n N + n N )x> for all x « Z N . 

From (1.8), for x € Z N 

(3.3) 2<4 N *n N x,x> - <fl N *n N x,fl N *n N x > + <C N x,C N x> = 0 . 

Hence by subtracting (3.1) from (3.3) 

2 <U N - P% N *n N )x, (n N - n N )x> 

+ <5 N *(n N - n N )x, fi N *(n N - n N )x> - <a n x,x> = 0 

for all x € Z N . Or equivalently 

n N - n N = | e {^-BV* n N )t ((n N . ?F)B N B N \n N - rF) - a n ) 
x °(^ N -S N s N V)t dt 


(3.4) 
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Similarly, subtracting (3.3) from (3.1), we obtain 

(3.5) ri N - n N = r c (>4 N -s N B N *n N )t ((n N . ^N )s N fiN * (n N . fiN) + a n } 


X e U N -« N « N *n N )t dt 

Here, from Theorem 2.1, we have 


c (a"-bPb? nN H P N || S MjT*', t * 0 


with M 3 > 1 and w 3 > 0. Since n N P N -* n, strongly by Corollary 2.2 and 
B is compact 


p N (n N - n N )|| = ||(n N - n)P N 5|| - o as N 


Hence by the variation of constants formula and the Gronwall’s lemma, 

||e (4"-z>"B»*n") t pH. s M e (' u 3 + l| B II ||B N *(n N -n N ) ||)t 


It then follows that there exists an integer N 0 such that if N £ N 0 , 

„ w, 

|| e U -B B n )t p N|| <; M 3 e ~ , t * 0 . 

Now, from (3.4) for all x € Z N 

(3.6) <(n N - n N )x,x> - [ ||fi N (n N - n N ) e (^ N_5NfiN H^tx || 2 dt 

1 

= - f < e U N -* N * N *n N )t x> A N e (T4 N -B N B N *n N )t x>dt 
•*o 

and from (3.5) 

00 ♦ A 

(3.7) <(n N - n N )x,x> - [ p N (n N - n N )e (^ N - fiNfiN nN >*x || 2 dt 

= f < e (^ N -B N » N *n N )t x A N e (^ N -F% N *fi N )t x>dt 

These inequalities imply that for x € Z N 


- 10 - 




- 11 - 


4. Examples 

In this section we discuss the examples in which (H1)~(H4) are 

satisfied and then apply the formula (3.8) and (3.9) to obtain a convergence 
rate of n N to n. 

4.1 Parabolic Systems 

Assume V and H are Hilbert spaces and V C H with 

continuous dense injection i. Consider a bilinear form o on V such that 

(4.1) |o(u,v)| $ c ||u || ||v|| for u,v e V 

v v 

(4.2) o(u,u) > u||u||* - p||u|£ for u e V 

where u > 0. It then follows from [9] that there exists an operator A e 
£(V,V*) such that 

(4.3) o(u,v) = <-^u,v> v<tv for u,v e V , 

where V C H = H* C V* and H being the pivoting space, and that A 
on H with 

(4.4) dom(,4) = (x e H : Ax e H} dense in V, 

generates the analytic semigroup on H and V*. For given B € £(U,H) and 
C e £(H,V) consider approximating problems (Z N ,^ N ,fi N ,C N ); i.e. let Z N be a 
sequence of finite dimensional subspace of V and /4 N : Z N -* Z N is defined by 

(4.5) <-/l N z,x> = o(z,x) for z,x € Z N . 

Let P N be the orthogonal projection of H onto Z N and assume fi N = 

P n B and C N = CP N . We assume the approximation condition: 
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For each z e V there exists an element z N € Z N 

(4.6) such that ||z - z N || $ e(N) where e(N) -* 0 as N -* * . 

v 

It then follows from [2] that (HI) holds and if ( A,B ) is stabilizable and ( A,C ) is 
detectable, then (H3) holds. Thus from Corollary 2.2, n N converges strongly to 

n. However one cannot apply the formula (3.8)-(3.9) as it is, since 

nZ C dom(/4*) is the maximal regularity without assuming any regularity of C. 
This can be demonstrated by the following example. Consider the case when 
H = L 2 (0,1) and V = Hj(0,l), and 

f 1 d d . 

o(u,v) = u(x) v(x)dx for u,v e Hi . 

J 0 dx dx u 

Let us consider the Liapunov equation on H 


(4.7) A£ + EA + Q = 0 

where Q is self-adjoint operator on H. If for each z e Z, 

(Ez)(x) = [ <Kx,y)z(y)dy and (Qz)(x) = [ q(x,y)z(y)dy, 

J o J o 

then <t> satisfies A<f> + q = 0 with Dirichlet boundary condition, 

a 2 a 2 

where Ai p = <f> + <J> for <p e Ht[0,1] x [0,1]). In general (e.g., see 

dx 2 dy 2 

[ 6 ],[ 8 ]) 

f 1 f 1 fl a 2 12 ■ & lO cl ft 

I. L (b*l + 


(^»| 2 j dxdy | q | 2 dxdy 


This implies EL 2 C dom(/l) is the maximal regularity. 

Hence we will modify the arguments in Section 3 to improve the 
formula (3.8)-(3.9) for this example. First we note that in (3.2) for x e Z N 


| <C4*-/i N *p N ) nx,x>| = |o(x,(ri N - n)x)| 

* c||x||J| (n - 9»)x|| v by (4.1) 
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Thus from (3.2) 


(4.8) 7 = sup 


| <A n x,x > | 


^ 2 c sup 


||(n-n N )x ||y 


llx II *0 


x/0 || x | 


+ 2a0||g || sup 
x/0 


||g*(n-n N )x|| v 


where ||x|| h < «||x|| v . 


Lemma 4.1 


There exists a positive constant M such that 


( dN pN* n N\ t 2 2 

||e^ "" B n P N x|| dt S M||x || , and 


i: 


„(.4 N -£ N £ N *n N )t pN\ it * 


P I ' I )|| dt S M||x 


'H 

2 


Proof: Let ( N (t) = e^ -B B H )t pN x j t ^ q. Then ( N (t) satisfies 


dt 


( N (t) = (/l N -g N g N *n N )( N (t) , t > 0 , 


so that from (4.5) 


y 4 - » !N(,) IIh + 


= - (5 N *( N (t),/n N 5 N (t)> 


H 


and from (4.2) 

y 4- + “P N(,) llv 4 (p + 2S II®II 2> P"< , >l£ • 

The integration of this inequality with respect to t yields 

Tll< N <‘>l£ + u j’ P N «)|lv * T || t N C 0) ||* ♦ (P + 2B||B|| 2 ) }‘ ||5 N (s)||’d S . 
Now the lemma follows from Theorem 2.1. 


Q.E.D. 
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It then follows from Lemma 4.1 and (4.8) that 

f <a n e (^ N -s N fi N *n N )t x ^ e U N -B N B N *n N )t x> 

•*0 

f" / jN H N fi N* n Nu N 2 2 

< 7 ||e^ ~ B B n '* P N x|| dt $ M7||x|| . 

J O V H 

( jN R N H N*nN\ t 

Similary for ?S A ~ a a 11 / l , t * 0. Therefore we obtain, using (3.6) and 
(3.7), 

(4.9) || n N - n N || $ My . 

where y is given by (4.8). 

Consider the (1-dimensional) parabolic control system [2]; 

3 3 3 3 

— z(t,x) = — (p(x) — z) + q(x) — z + r(x)z 

m 

+ E bj(x)Uj(t) in (0.1) 


i=l 


with boundary condition z(t,0) = z(t,l) = 0, where p e €*(0,1), being bounded 

d 

below by a positive constant u, — q, r e L (0,1), and b: € L 2 (0,1), i = l,...,m. 

dx 1 

In this case, H = L 2 (0,1) and V = Hj(0,l), and the bilinear form o is 
given by 


o(u 


f 1 d d d 

,v) = [p(x) — u — v - (q(x) — u + r(x)u)v]dx . 


dx dx 


dx 


B: IR m -* L 2 (0,1) is defined by 


(Bu)(x) = E bjWuj for u € IR™ , 
i=l 

and dom(/l) = dom(/l*) = H 2 (0,1) n Hq( 0,1). Let us consider the following 
finite dimensional subspace Z N of V: 

N-l 

Z N = {z e H : z(x) = E ct i B|' f (x) , aj e IR) 
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where i = 1,...»N-1 are the linear B-spline elements on the interval [0,1]; 

i.e.. 



0 , elsewhere 


Then the approximation condition (4.6) is satisfied [8]. Suppose (4,B) is 
stabilizable and (A,C) is detectable. Then (1.5) has the unique solution n 
and using a similar arguments to those given above to show the regularity of 
solutions to Liapanov equation (4.7), one can show that for x € H, nx e 
dom (A*). Since A* is closed in H and dom(A*) C V, by the closed graph 
theorem, there exists a positive constant k., such that linzll , S kJlzll , 

1 11 H 2 (0,1) 111 ^L 2 (0,1) 

Hence the fundamental error estimate (e.g., [8]) gives 


|® • " NZ |I L 2 < k 2 

||® ' " NZ ||„1 * k 3 
n o 

for some positive constants 

ii nN -" N ii * k [^] 



k 2 ,k 3 . Now it follows from (4.8) and (4.9) that 
for some constant k. 


4.2 


(4.10) 


Hereditary Differential Systems 

Consider the hereditary differential system in FP; 
x(t) = A 0 x(t) + AjX(t-r) + | A(0)x(t+0)d0 + Bu(t) 

J -r 

x(0) = n and x(0) = ^(0), -r $ 0 < 0 
y(t) = C x(t) 
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and the optimal control problem; for given initial data z = (b,0) £ fi" x 
L 2 (-r,0; IR") , minimize the cost functional 

(4.11) J(u,z) = f (|y(t)| 2 + | u(t) 1 2 )dt . 

J o 

Here, x e IR", u € IR" 1 and y e IR P and the element of A( ) is square 

integrable. It is shown [1] that (4.10) and (4.11) are equivalently formulated as 
the problem (1.1) - (1.4) on the product space Z = IR" x L^-^OjIR 11 ); i.e., z(t) = 
(x(t),x(t+ •)) e Z is the mild solution of (1.1) with 

dom04) = ((n,<(>) e Z : <p e H\-r,0) and <p(0) = b) , 

for (4>(0),<M € dom(/4) 

A(m,<t>) = (A o <K0) + A,4>(-r) + | A(e)4<e)de, i) . 

J -r 

The input operator B : JR 1 ” -» Z and the output operator C : Z -* IP? are 
given by 

£u = (Bu,0) € Z and C(0,<t>) - Cb . 

Let us consider the averaging approximation [1] of (4.10); let 

N 

Z N = {z € Z :z= (a 0 , E a k x j ), a k € R n , 0 S k « N) C Z , 

k=l E- — r, r) 

N N 

and has the matrix representation (Q N )‘*H N on JR"( N+I ) when Z N is 

identified with |R"( N+1 ) by its coordinate vector col(aJ,...,aJ), where the block 
diagonal matrix Q N and the block Hessenberg matrix H N are given by 



I 

r 



r A N a n 

a O ‘ 

a n 1 

q n = 

— I 
N 


and H n = 

I -I 




r 

— I J 


I 

-I 


N 
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i-1 N-l 

with Aq = A 0 , A^= j’Tr r A (9)d9 and A*J = A 1 + j‘ A(0)d0. Note that 

r ~ r 

N 

f P n 5 = B and CP N = C. Set fl N = B and C N = C. Then (,4 N )* has the 

T 

matrix representation (Q N ) _1 H N on R“( N+1 ). (Hl)(i) is proved in [1] and 

(Hl)(ii) is proved in [3]. Using the arguments in [5], [7] one can show that 

(H3) is satisfied (i.e., (i) is straightforward but (ii) is not so). Thus, the 

formula (3.8)-(3.9) yields 

||n N - n N || $ 2||(/i* - /i N *P N )n|| 

By the regularity result in [4], if A( ) € H 1 (-r,0;R nxn ), then 
A*n + C*C € dom(/i*) 

where dom(/l*) = {( y,0 ) € Z : 0 e H 1 and 0(-r) = A^y) and A*( y,0) = 

(0(0) + A*y, - 0(0) + ^ T (-)y) « Z [3]. Since C*C(7,0) = (C T Ch,0) € Z for 

(7,0) € Z, this implies that if nz = (y ,0), then 0 e H 1 so that 0 € H 2 , and 

since A* is closed, ||0|| < M||z|| for some constant M. It then follows 

from the arguments and error estimate in [1], [3] that 
* M 

||C4*-.4 N P N )n(y,0)|| < — (|y | + ||0|| 2 ) 

' / N 

Hence we obtain ||n N - n N || = 0( — ) . 
i 

) 

t 

[ 
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